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Abstract — The detection problem in the Gaussian interference 
channel is addressed, when transmitters employ non- Gaussian 
schemes designed for the single-user Gaussian channel. A struc- 
ture consisting of a separate symbol-by-symbol detector and a 
hard decoder is considered. Given this structure, an optimal 
detector is presented that is compared to an interference- 
unaware conventional detector, an interference-aware successive 
interference cancellation (SIC) detector, and a minimum-distance 
detector. It is demonstrated analytically and by simulation that 
the optimal detector outperforms both the conventional and 
the SIC detector, and that it attains decreasing symbol error 
rates even in the presence of strong interference. Moreover, 
the minimum-distance detector performs almost as well as the 
optimal detector in most scenarios and is significantly less 
complex. 

I. Introduction 

The Gaussian interference channel has significant practical 
interest, because it can model real-world communication sys- 
tems. Examples include cellular systems where neither base 
stations nor mobile stations coordinate with each other and 
bundles of digital subscriber lines (DSL) without any real-time 
coordination among modems of different users. The interfer- 
ence channel is one of the most challenging channels studied 
in Information Theory, and the complete characterization of 
its capacity region remains an open problem |[T|, 111, O, llH, 

A significant part of the research activity on the interference 
channel has focused on determining its capacity and the coding 
schemes with which it can be achieved. Another area of con- 
siderable activity is power allocation for frequency- selective 
Gaussian interference channels O, ||9l, Q. For power alloca- 
tion it is typically assumed that each user employs encoding 
and decoding schemes designed for the single-user Gaussian 
channel. Moreover, the interference is treated as independent 
identically distributed (i.i.d.) Gaussian, similar to background 
noise. Therefore, it is assumed that the transmitters and the 
receivers are the same as for the single-user Gaussian channel. 

Thus, a gap seems to exist between research on the capacity 
region and research on power allocation for Gaussian interfer- 
ence channels. Given the current technology, near-capacity- 
achieving encoding and decoding schemes are very complex 
to implement in practical communication systems Rl, On 
the other hand, power allocation is already performed in some 
systems. It is therefore of interest to improve the performance 



of the latter, while keeping complexity at a reasonable level. 

In this paper, an attempt is made to bridge this gap. It is 
assumed that simple encoding schemes designed for single- 
user Gaussian channels are employed. On the other hand, 
decoding schemes are explored that do not necessarily treat 
interference as i.i.d. Gaussian. 

Soft or hard estimates can be used for decoding. Soft 
decoding performs better than hard decoding. However, hard 
decoding is simpler because, unlike the decoding algorithm, 
the detection does not depend on the employed encoding 
scheme. Moreover, hard decoding can provide some insights 
on the decoding of single-user-coded signals in the presence 
of interference. In order to perform the optimization of the 
detector in a general context, without assuming a specific 
encoding scheme, hard decoding is assumed in this paper. Soft 
decoding is considered in 1 10 |. 

The focus of this paper is the development of an 
interference-aware detector for hard decoding receivers that 
can be applied to any coding scheme designed for single-user 
Gaussian channels. A conventional detector is first examined 
briefly that does not take the statistics of interference into ac- 
count. Then an interference- aware successive interference can- 
cellation (SIC) detector is described, followed by a minimum- 
distance detector. Finally, the optimal detector is derived. The 
detectors are compared in terms of the symbol error rate (SER) 
analytically and by simulation. It is shown that the optimal 
detector outperforms significantly both the conventional and 
the SIC detector. Moreover, the performance of the minimum- 
distance detector, that is considerably less complex than the 
optimal one, is optimal for most values of the signal-to-noise 
and signal-to-interference ratio. 

The remainder of this paper is organized as follows. The 
model of the system that is considered is presented in Section 
nil followed by the four detectors in Section |llll The perfor- 
mance of the detectors is compared analytically in Section |IV] 
and using simulations in Section (V] 

II. System Model 
A two-user Gaussian interference channel is considered 

yi[m\ hi^i[m\xi[m\ hi^2[m\x2[m\ Zi[m\, 

y2[m\ = h2,i[m]xi[m] ^ h2^2[rn\x2[rn\ ^ Z2[rn\, (1) 



where Xj [m] is the signal of transmitter j at time m, hij [m] 
is the gain of the channel from transmitter j to receiver i, and 
Zi[m] is the background noise of receiver i, for z = 1,2 and 
j = 1,2. The background noise is modeled as a real Gaussian 
random variable with variance for baseband systems and 
circularly symmetric complex Gaussian with variance 2a^ for 
passband systems. It is assumed that each receiver i knows all 
channel gains hij[m], which is a typical assumption for any 
advanced receiver for interference channels |5|. The model is 
shown in Fig. [T] As can be seen, a practical transmitter is 
considered where each symbol is a point of a finite signal 
constellation. Examples include pulse-amplitude modulation 
(PAM), quadrature-amplitude modulation (QAM), and phase 
shift keying (PSK). In the following, the time index m will 
be omitted for simplicity whenever there is no potential for 
confusion. 

III. Detectors for the interference channel for 

SINGLE-USER ENCODING SCHEMES 

For the receiver, a suboptimal, but practically viable and 
frequently employed approach, is to design a symbol-by- 
symbol detector and a decoder separately as in Fig. [T] This 
structure is used in this paper and allows optimization of the 
detector independently from the decoder. 

A. Conventional Detector 

In the absence of interference, the optimal detector for xi 
given a hard-decoding receiver maps the received symbol to 
the closest point of the constellation of transmitter 1 scaled 
by hi^i. When interference is present, it is treated by the 
detector as part of the background noise. Specifically, in 
©, the interference term /ii,2^2 is lumped together with 
the background noise term zi. The decision regions of the 
conventional detector for 2-PAM are shown in Fig. [2l 

In many cases, interference can be safely assumed to be 
Gaussian. For example, in DSL, combined interference from 
many users can be considered Gaussian. However, in other 
cases, the modeling of interference as a Gaussian signal 
may not be accurate. For example, in the case of a cellular 
system employing fractional frequency reuse, the number of 
non-negligible interferers can be restricted to a small value. 
Even when the interference comes from multiple users as in 
DSL, it can improve the system performance to treat a few 
strong interferers separately from the rest, which can still be 
approximated as Gaussian. Thus, in the following, detectors 
are considered that exploit the statistics of the interference, 
which can be different from Gaussian. 

B. Interference -Aw are Detector 

The conventional detector is optimal if the unwanted signals 
{i.e., the sum of noise and interference) are Gaussian. When 
the interfering users employ finite constellations, the distribu- 
tion of the unwanted signal is not Gaussian. The performance 
of the receiver can be improved by using a detector that takes 
into account the actual distribution of the interference. 



It is assumed that the modulation scheme of transmitter 2 
is known to receiver 1 and that the gain hi ^2 is known during 
each time instant m. Therefore, the distribution of the received 
interference signal hi ^2X2 is also known. 

1 ) SIC Detector: For the development of an interference- 
aware detector, the concept of successive interference cancel- 
lation (SIC) can be borrowed from the multiple access channel 
(MAC). Even though receiver 1 is interested in xi, it can 
obtain an estimate X2 of X2 first, by treating xi as Gaussian. 
Then the receiver can detect xi from ^1-/11,2^2. The decision 
regions for the SIC detector when 2-PAM is used by both 
transmitters are shown in Fig. [2l 

The performance of the SIC detector will be good when the 
power of the interference is much larger than the power of the 
desired signal (small SIR). On the other hand, for large SIR, 
the conventional detector may perform better than the SIC 
detector. Based on this observation, an ordered SIC detector 
can also be considered. For example, when 2-PAM is used 
by both transmitters, xi can be directly estimated for SIR > 
dB, whereas the SIC decoder can be used for SIR < 
dB. In the description of the minimum-distance detector that 
follows, it is shown that this ordered SIC can attain the same 
performance as the minimum-distance detector for the case of 
2-PAM. However, in general, for other constellation sizes, the 
optimal ordering sequence is not obvious. 

2) Minimum-Distance Detector: The SIC detector may be 
affected adversely by error propagation. Because symbol-by- 
symbol detection does not benefit from coding, this can lead 
to severe performance degradation at small interference-to- 
noise ratios (INR). To avoid error propagation, xi and X2 
can be estimated jointly rather than sequentially. Detection 
of xi can be accomplished in three steps. First, a combined 
received constellation point hi^iXi-\-hi^2X2 is formed for each 
pair (xi,X2) ^ Si X S2 where Si are the transmit signal 
constellations. The detector then determines the combined 
constellation point that is closest to yi among all the points in 
^1,1^1 + hi^2S2 and the corresponding (fi,f2). Finally, xi 
from (xi, X2) is chosen as the estimate of xi. It can be easily 
shown that this decision rule minimizes the probability of mis- 
detection of the pair (xi,X2) when all constellation points in 
the finite alphabet sets and ^2 are equiprobable. 

As in the SIC detector, X2 is also estimated, but only 
through the joint estimation of xi and X2. However, unlike 
the SIC detector, the estimate of xi does not rely directly 
on the estimate of X2. This eliminates the effect of error 
propagation in low INR. Therefore, xi may be correct even 
if X2 is incorrect. In summary, the minimum-distance detector 
estimates both xi and X2, but only uses xi; the conventional 
detector only estimates xi, and the SIC detector estimates X2 
and xi sequentially. 

3) Optimal Maximum-Likelihood (ML) Detector: The 
minimum-distance detector is not optimal with respect to 
minimizing the probability of mis-detection of the desired 
signal. It can be shown that the optimal, maximum-likelihood 
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Fig. 1. System Model 



(ML) detector for xi given the received signal y is given by 
xi{yi) = argmax^ Jexp(-|?/i - hi^iXi - /ii,2^2p/2a-|), 

Xi 



X2 



(2) 

where the summation occurs over all the symbols of the 
constellation of the interferes Compared to the minimum- 
distance detector, the optimal ML detector is rather complex 
in that it requires the calculation of the sum of exponential 
functions and the calculation of the Euclidean distance from 
the received signal to all combined signal constellation points. 
As will be seen in the following, except for channels where the 
power of the interference is comparable to the signal power 
and the SNR is small, the performance of the minimum- 
distance detector is almost as good as that of the optimal 
detector. Therefore, the significantly less complex minimum- 
distance detector can be employed instead. 

The decision regions of the four decoders are shown in 
Fig. [21 for the case when both transmitters use 2-PAM. As can 
be seen, when SIR < dB, the decision regions of the optimal 
ML detector change slightly compared to the minimum- 
distance detector. This happens because, unlike the minimum- 
distance detector, more than one combined symbols contribute 
to each decision as can be seen in (|2|. The difference is 
more pronounced for small SNR and disappears as the noise 
variance decreases and the exponential terms decay faster. It 
can also be seen that, for 2-R\M, the decision regions of the 
ordered SIC decoder will be the same as for the minimum- 
distance decoder. However, this does not hold for arbitrary 
PAM constellation size. 

The first three detectors are similar to detectors for a multi- 
input- single-output (MISO) system with 2 transmit antennas 
and 1 receive antenna. Specifically, the conventional detector, 
the SIC detector, and the minimum-distance detector corre- 
spond to a linear equalizer, a decision feedback equalizer, and 
a maximum likelihood detector for a MISO system using more 
than one spatial streams. Nevertheless, in practice, only one 
spatial stream is transmitted in a MISO system, using either 
space-time coding or beam-forming because use of multiple 
streams does not lead in capacity gains, and requires more 
complex receivers compared to the single- stream case. 
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Fig. 2. Decision regions of the decoders for weak and strong interference. 



IV. Comparison of the detectors 
A. Symbol Error Rate 

When 2-PAM is used by both transmitters, the SER of the 
first three detectors can be derived easily using Fig. O How- 
ever, the resulting expression is quite long and complicated. 
Thus, only approximate SER expressions, based on the nearest 
neighbor union bound (NNUB) approach |11|, are given 
below. The derivation of the expressions is based on finding 
the minimum distance between points of the constellation 
^1,1 5*1 + ^1,2 5*2 that decode to different values of xi, and 
is omitted here for brevity. The exact SER expressions and 
the derivations can be found in fT2| . The SER expressions for 



the optimal ML detector are even more complicated, even for 
the 2-PAM case. Therefore, in this paper, the expressions of 
the minimum-distance detector are used as an upper bound for 
the performance of the optimal detector. 

The SER for the conventional detector when 2-R\M is used 
by both transmitters is approximately equal to 



e,conv 




SIR> 1 

SIR < 1, 



(3) 

where Q{x) = e'^'^'^dt is the Q-function. The SER 

for the SIC detector is 



,SIC 



\Q (^V'SNR - 2v1nr) , 
\-\Q fv^SNR- vInr) , 
\-\Q (2vlNR - VSNr) , 

^q^vIM-Vsnr), 

Q fv^SNR) , 



SIR>4 
I < SIR < 4 
1 < SIR < I 
I < SIR < 1 
SIR< |. 



(4) 

Lastly, the SER of the minimum-distance detector is given by 



,MD 



\Q fv'SNR 

^q(Vinr- 
q(7snr), 



- Vinr), 
Vsnr) , 



SIR > 1 

I < SIR < 1 

SIR<i. 



(5) 



From ^ it can be seen that the minimum-distance detector 
behaves roughly as follows. For SIR > 1, the minimum 
distance of the constellation of the desired signal is reduced 
because of interference. For | < SIR < 1, the detector 
behaves as if the minimum distance in the constellation of 
the interference were reduced by the desired signal. For SIR 
< |, the interference is very strong and its effect on the 
SER is negligible. This agrees with the information theoretic 
results for the strong interference channel. Comparing ([3]) and 
([5]), it can be deduced that the minimum-distance detector 
outperforms the conventional detector for SIR < 1. In fact, 
the SER of the conventional detector exceeds 1/4 for SIR < 
1. From © and ©, for SIR > 1, the SER of the minimum- 
distance detector is smaller than the SER of the SIC detector. 
The performance of the SIC detector is particularly bad in the 
region 1 < SIR < 4. 

Although only 2-R\M was considered, the SER for other 
modulation schemes can be derived in a similar way using 
the NNUB approach. However, the resulting expressions are 
typically quite complicated. It can be shown that the per- 
formance of the conventional detector is the same as that 
of the minimum-distance detector when the SIR exceeds 
a threshold value SIR^/^. On the contrary, the conventional 
detector exhibits an error floor for SIR < SIR^/^. For 2-PAM, 
SIRt/i = 1. The following proposition holds for any PAM 
constellation size. The proof is given in |[T2ll . 

Proposition 1. For the 2-user interference channel where 
both transmitters employ PAM, the SER of the conventional 



detector reaches an error floor when the SIR is below a 
threshold SIRt^. Mathematically, for SIR > SIRt^, Pe,opt = 
Pe,conv ^ as SNR ^ oo. For SIR < SIR^/,, P^ opt ^ 
as SNR oo, except for a finite number of SIR values. On 
the other hand, Pe,conv Pg floor 7^ SNR oo, i.e., 
the SER reaches a non-zero error floor. 



SIRt^ = {Ml - 1)(M2 - 1)/(M2 + 1), 



(6) 



where Mi and M2 is the constellation size of transmitter 1 
(desired) and transmitter 2 (interfering), respectively. 

Similarly, the SER of the SIC detector reaches an error floor 
when the SIR is between two threshold values SIRi and SIR2. 
Pe,SIC ^ Pe,floor,SIC ^ as SNR ^ 00, when SIRi < 
SIR < SIR2. 



SIRi = (Ml + 1)/ {(Ml - 1)(M| - 1)} , and 
SIR2 = 4(M2-1)(M2-1)/(M2 + 1)=4SIR,/,. (7) 



Although only PAM was considered for the analysis, similar 
conclusions hold for passband systems with QAM. 

B. Complexity 

At most Ml — 1 comparisons are required by the con- 
ventional detector, compared to at most Mi + M2 — 2 for 
the SIC detector. The maximum number of comparisons for 
the minimum-distance detector is equal to M1M2 — 1. This 
increase in complexity is not important when compared to 
the complexity of other parts of the receiver (such as a 
Viterbi decoder that may follow the detector). Moreover, 
in practical implementations, the number of comparisons is 
reduced substantially by optimizing the design of the sheer. 
Finally, the optimal ML detector is significantly more com- 
plex. Nevertheless, as is shown in the following, it can be 
replaced by the minimum-distance detector in most cases. 

V. Simulation Results 

The performance of the detectors is evaluated by Monte 
Carlo simulation. Fig. [3] shows the SER when 2-PAM is used 
by both transmitters. It can be seen that the SER of the 
conventional detector reaches an error floor when SIR=— 3 dB. 
However, the optimal detector performs very well even at that 
very strong interference environment. In fact, as can be seen 
in the figure, the minimum-distance detector performs better 
for SIR = -3 dB than for SIR=3 dB for a given SNR. The SIC 
detector is as good as the optimal detector for SIR=— 3 dB, 
but its performance diverges when SIR=3 dB. As can also 
be seen in Fig. [3l the expressions derived using the NNUB 
approximation are very close to the simulation results. 

In Fig. |4] the SER for the minimum-distance detector and 
the optimal ML detector is compared. The minimum-distance 
detector performs almost as well as the optimal ML detector 
except for very low SNRs of less than 3 dB when SIR = — 1 
dB, i.e., the power of the interference is comparable to that of 
the desired signal. 

The SER for the case where 4-PAM is used by both trans- 
mitters is plotted in Fig. [51 It can be seen that the minimum- 
distance detector works well for both SIR=3 dB and SIR=— 3 
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Fig. 3. Symbol error rate (SER) for the conventional detector, the SIC detec- 
tor, and the minimum-distance detector for a two-user Gaussian interference 
channel when 2-PAM is used by both transmitters. 
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Fig. 4. Symbol error rate (SER) for the minimum-distance detector and 
the optimal ML detector for a two-user Gaussian interference channel when 
2-PAM is used by both transmitters. 



dB, whereas the conventional detector and the SIC detector 
fail. This agrees with Proposition 1, since, from ©, SIR^^ ^ 
9.54 dB and -9.54 dB = SIRi < SIR < SIR2 = 14.3 
dB.. Therefore, use of the minimum-distance detector enables 
employing 4-R\M over the interference channel that would 
otherwise be impossible. 

Finally, in Fig. [6l the SER is depicted when 4-QAM is used 
by both transmitters and transmission occurs over a fading 
channel. The distribution of each channel gain is assumed to be 
i.i.d. complex Gaussian. The conventional and the SIC detector 
suffer significantly from fading even for an average SIR of 6 
dB. On the other hand, the minimum-distance detector does 
not exhibit an error floor even when the average SIR is equal 
to -6 dB. 




SNR (dB) 

Fig. 5. Symbol error rate (SER) for all 4 detectors when 4-PAM is used by 
both transmitters. 
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Fig. 6. SER for all 4 detectors in a Rayleigh fading channel when 4-QAM 
is used by both transmitters. 
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